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Memory, Knowledge, and the Answering of Questions^ 



Donald A. Norman 
University of California, San Diego 

The Answering of Questions 
How do people answer questions? At first, the process appears reason- 
ably si.nple. A person is asked a question, he retrieves the relevant in- 
formation from his memory, and then he responds with the appropriate answer. 
According to this notion, the traditional psy<;hological studies of ■e»ory 
should tell us something about the way that knowledge is used to answer ques- 
tions, i-his is not so; there is much more to answering questions than 
simply retrieving something from memory. For one thing, the question wmy 
be phrased in ways that differ from the format of the storage used for the 
relevant information. For another the answer may have to be derived fro« 
the logical consequences of the information that is known about the question- 
ed topic combined with the general knowledge that has been acquired about 
the world and its physical and logical laws of operation. And then, even 
once the relevant information has been collected together, the answer still 
cannot be .given directly, for it is also necessary to consider why the ques- 
tion was asked to determine what the answer should be. As a result, it 
often happens that the best way to answer a question is to TCspondJ)y ask- 
ing a question. And finally, suppose the information relevant to the qucs- 
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tion is not available, what kind of an answer should be given then? Thus, 
the study of the way that people answer questions leads to a study of memory, 
thought and understanding. A wide vai'lety of cognitive capabilities are in- 
volved in dealing with this deceptively simple part of our everyday activ- 
ities.. ^ 

In this paper, I concentrate my discussion upon the answering of sim- 
ple questions, but even this restriction will not greatly reduce the range 
of topics that must be covered. Memory, thought, and understanding seem 
all intertwined in that vast morass known as ''cognitive processing.'' To / 
study even one small aspect of human thought appears not to be possible, { 
for to study one topic leads immediately to a study of all the others. 
This exercise has value in that it forces the examination of a large series 
of important issues of human performance. What starts off as a simple ques- 
tion about one aspect of human perfonnance leads to the development of a 
theory of cognition, including a theory for the representation of knowledge 
in human memory, a theory about the use of cognitive structures, a considera 
tion of the knowledge one person must have of the kn(>w ledge and motivations 
of another, and even a discussion of learning and teaching — the first- ^ 
steps towards a theory of instruction. . ^ 

The simplest type of question that can be asked of a person is to ask 
whether he is familiar with a fact. This question is related to the tests 
in the traditional psychological studies of human memory: a list of items 
is presented to a subject and then, at some later time, he is asked what he 
c^.n recall or recognize. These studies have yielded much information about 
the overall structure of the information processing system: about short-term 
and long-term memory, about phonemic and semantic encoding, about organiza- 
tion, and about simple decision strategies . . Bijt it is not with this level 
of question that I will be concerned. These are not the types of questions 
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that characterize our daily, noniial interactions. 

•me paradigm question, the one that started my interest^ is this: 

What is the telephone nu]*er of Charles Dickens, the novelist? (i) 
According to what is usually assumed about the retrieval of infoimation,. 
this question should be answered by searching for the infomation in mem- 
ory about Charles Dickens and telephone nurfcers - it is a si^le paired- 
' associate task. Because no such association will exist, the subject should 
immediately respond, "1 don't know." No one says "1 don't know" to this • 
question. Rath-er, people claim not even to bother to search for the answer; 
they si,^ly reject the question as illegitimate. In fact, by examining a 
set of questions of this nature, it.becomes clear that considerable pre- 
processing precedes question answering. Similarly, there are other stages 
of processing, including search, deduction, and then, various levels of 
postprocessing, m order to know how people attempt to answer questions, 
wc need to know how people store infonnation and how they co*ine general 
infonnation about' the world with information about the question to derive 
an appropriate an..wer - in short, how people think. Moreover, we will 
see that in order to answer questions, people must use: 

* simple inference 

* knowledge of causality 

* their understanding of physical laws 

Mr 

* general knowledge of the world 

, * their understanding of what the person asking the question 
already knows . 

t ^uestion Answering by Simple Retrieval 
•U^t how do questions get answered^ Let us start our studies by exam- 
the difficulties enco^tered with a strategy of simple retrieval. 
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The Telephone Number Problem 

Consider the following set of questions: 

What is X's telephone number? Where X is: 
John Happenstance 
□larles Dickens 
The President 
A local restaurant 
A friend 
You 

If these questions could be answered by simple retrieval 'from memory, the 
algoritTim would look something like this: i 

1. Search memory for the structure equivalent to "the telephone num- 
ber of A is B 

2. If successful, then B is the number. 

3. If not, then the answer is "I don't know." 

This algorithm has one immediate difficulty, that caused by what has come 
to be known as the para phrase problem . That is, the information may actually 
exist in memory, but in a different fomiat than that of the question. We 
might have the telephone number of X's home, or of his spouse or roommate, 
or we may not encode t;he number with the relation the-te lephone-number-of 
but" rather with phone-number, or extension . or simply as his-nuinber-is . All • 
these variations on the information require expansion of the simple algorithm: 
if the first search fails, it is necessary to consider variations on the que^- 
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But even the most casual thought about these questions indicates that 
it is the basic philosophy of tie algorithm that is wrong. For some of the 
questions, we do not even bother checking in memory for the relevant informa- 
tion. With the reque-t for the telephone number of John Happenstance, the 



typical response is something like '*Who on earth is he?'* With the requests 
about the numbers of Charles Dickens and of the President, it is clear that 
we determine that the phone number was never learned (or could not even have 
existed), so again the response is either explanation or an incredulous re- 
turn question, not a simple ''I don't know." In the situation where the cor- 
rect answer is actually kno-rvn, such as wh^ • asked for the number of an in- 
frequently called telephone, then the answer is likely to take a long time 
to be retrieved. This is in fact just the opposite of the prediction from 
the simple search algorithm: the algorithm should produce the fastest respon 
time when the nuiTA)er is actually known. 
Stages of Question Answering 

Several important conclusions result from these simple examples. First, 
question answering proceeds by stages. There appears to be a preliminary 
rapid, cursory se^arch of the information presented to determine if anything 
at all is known about the query. If this rapid search fails, then the reason 
for the failure determines the type of response made to the question. Thus, 
to the question about Happenstance, the response is to get more information 
about Happenstance himself. 

The need for an initial, rapid search show5 up in roost of the psycholog- 
ical experiments that have been performed on search strategies. For example, 
Collins and QuiUian (1969) found that it took less time for a person to ans- 
wer that the statement a canary is a fish is false than to answer that a 
canar y has skin is true. Similarly, Meyer (1970) found that it took less 
time for his subjects to answer false to the statement some chairs are peo- 
ple than true to the statement some pilots are men . For both these examples, 
the simple algorithm stated earlier would predict longer search times for 
the fals e answers. In these cases it looks like people make a rapid ini- 



tial search to find first whatever relation does exist in memory among the 
.terns in the question.^ men, the results 0/ that search are examined to 
see whether they are sensible or not. If not, the search is abandoned. If 
-so, then a more detailed analysis and, perhaps, mere search is required,' ■ 
In Meyer's case, the initial search is used to see whether there is any 
overlap in the meaning of the two tenns to be compared: if not, answer 
fals£; if so, more analysis is needed,'* 

Memory and General Knowledge 

The Floorplan Problem 

External knowledge about the world offers constraints on the possible 
interpretations of information retrieved from memory. Consider how someone 
draws a floorplan from memory. Buildings have walls and supporting struc- 
tures. If a staircase occurs on one floor, then it must appear in a cor- 
responding location on the next adjoining floor. Toilets are often located 
one above the other, especially in public buildings. There must be passage- 
ways ;or people to get from one room to another, and all rooms must have 
entries. In remembering a floorplan, all these facts combine with whatever 
is actually remembered. In drawing floorplans, the role of inferred know- 
ledge is made clear because the constraints of building construction are 
well known. In most memoiy retrieval tasks, external knowledge is also used, 
but usually its role is not so easy to discover. 

We get clues about the way different types of knowledge interact by 
examining errors. Consider the following example. In the married students- 
housing at the University of California, San Diego, all apartments have a 
balcony that is entered from the living room. Figure 1 shows the architect's 
floorj)lan of the apartment. 
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Figure 1 



Residents of these apartments have some surprising ideas about their own 
apartments. Figure 2 shows a typical floorplan drawn by a resident of one 
of the apartments: note the way he drew the balcony. 



Figure 2 



People who had lived in the apartments for long, periods of time (measured 
in years in some instances) thought the balcony was constructed flush with 
the exterior of the house, whereas, in fact, it extended beyond (in the 
normal way). The reason for the confusion is clear from the real floor- 
plan in Figure 1- This balcony design is quite unusual in that there is 
a solid wall on both sides of the balcony; the wall on the right is as- 
sumed to be the outer wall of the adjoining bedroom. Normally, this would 
be an excellent assumption, but in this case it is false. This particular 
building has a peculiar balcony design, but one that is imroediately obvious 
simply by lookinp at the building from the' outside. The error reveals the 
constructive nature of the retrieval process. Forty-seven percent of the 
people who have been tested made this same error in drawing the balcony, 
even though some of them sketched the plan while they sat within the living 
room itself. Another 20% of those tested have had uix'^ficulty with the bal- 



cony, correcting their drawings several times before satisfying themselves. 
^ (A total of IS^people have been tested.) The error and the difficulties 
reveal the potent influence of knowledge of the world in reconstructing 
knowledge from memory.^ 
Knowledge of the World 

Here is another example to illustrate how a detailed knowledge of the " 
world gets used even in th^ most unexpected places, I draw the example 
from a discussion by Minsky (1968, p. 22). 

Peter put the package on the table. (2) 

Because it wasn^t level, it slid off. (3) 
The pair of sentences is, easy to understand. The problem is to determine 
just how the pronouns get matched up properly with their appropriate refer- 
ent: the first it in sentence 3 (it J could refer to either the table or 
the package, the second Jjt^ ^^^2^ refer to the box. Syntactical know- 

ledge alone cannot identify with which referent each it^ belongs. Consider 
the pair of sentences 

Peter put the package on the table, (2) 

Because it was round, it rolled off. (4) 
In sentence 4, i_tj must refer to the package, not the table. 

To decipher sentences 3 and 4 properly requires some knowledge about 
objects, about causes of movement, about the things that can roll and slide, 
and, in general, about some of the laws ^of physics. Moreover, soine deduc- 
tion is aUded freely, because if now asked 

Where is the package now? (5) 
the answer would probably be something like ''I'm not sure, but probably on 
the floor. 
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When concepts are represented within memory they must fit within the 
framework provided by the knowledge of the world. This general world know- 
ledge is likely to be extremely extensive, containing as it/must all the 
learned information that we have come to take for granted. In fact, it is 
exactly the material that we take for grahted that is most important to 
understand: any concept wo have to exert anv conscious effort to use is 
probably not an important one foi everyday understanding. Unfortunately, 
it is the latter concept that is. easier to study: the fomer the more 
difficult. 

The Structural Framework 

One view of the role of world knowledge is to consider it as a 
structural framework upon which newly acquired information must be fasten- 
ed. TTiis skeletal or schematic representation then guides both the inter- 
pretation of information and also the search for new infonnation to fill 
the gaps left in the structure. This notion is especially clear for the 
analysis of language. Verbs, for example, imply a particular structure 
of concepts and other events. Thus, upon hearing the phrase 

. . .put the package. . . 
the verb £ut carries with it a framework that must be filled for complete 
understanding to occur. In particular, a verb like put requires an object 
(the package, in this case), a location, and an agent, someone who in- 
stigates the action. Moreovei. the object must be movable as in "put the 
package on the chair" or creatable. as in -put the answer in the square." 
the location must be capable of holding the object, a prior location of 
the object is assumed to exist (although it need not be stated), and the 
agent must be one capable of moving the object. 
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Ina different manner J suppose 'we are told that 



Chris is the husband of Pat . (7) 

Pat is Tom's mother (8) 
Sally is Tom's sister (9) 
We now know the sexes of all the characters, the fact that Pat is the wife 
of Chris and the mother of ^oth Tom and Sally, that Chris is the father of 
both Tom and Sally, and even that Chris and Pat are older than Tom and Sally. 
Moreover, we would not be surprised to learn that they all live in the same 
house. In short, each simple familial relationship carries with it a complex 
structural framework. This structure tells us how to elaborate upon what is 

given. Moreover, it tells us what information is missing an^ what of the 

J* 

information we have been given does hot fit- When does the elaboration orcur? 
Is it at the time the sentences are /heard or when a question about the informa- 
tion is answered? It is easy to show that at least some simple elaboration 
occurs very early, tf we are told the following j . ^. 

Sam is Henry's father , (^^^ 

Sam is Tom's wife (^^^ 
we know immediately that either there are two people named Sam or that some- 
thing is wrong. ^ 

The Representation of Information in Memory 
Let us now try and see just what a memory representation must contain 
in order that it be capable of dealing with the several issues just discuss- 
ed. I have suggested that the retrieval of information is preceded by a 
quick stage of checking, searching the memory for any relationship that exists 
among the items being asked about. Then there follows a more areful examina- 
tion of the information stored in memory. In addition, the structural frame- 
work of information about the world supports the specific knowledge of gen- 
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eral events. We know that Charles Uxckens had no telephone even though no 
one had ever told us that fact before. We know (incorrectly) that the balcony 
is flush with the rest of the house because we can "see" the exterior wall of 
the bedroom running up to the outer cdge^of the balcony. 

The job now is to devise a formal, particular representation that allows 
us to tost our uloas of memory, of the interactions of specific information 
and of the supporting structures of world knowledge, and of specific retrieval 
sch.m-s. My colleagues and I have devised one such possible representation. 
It seems quite effective, but it is yet too early to tell (see Rumelhart, 
Lindsay and Norman. .19 72).' Pormal methods of encoding infomaticn in a 
large data base are reasonably common, and our procedure is an amalgamation 
of ideas borrowed from many sources, with a few original ideas scattered 
here and there. We represent knowledge by means of a network representation, 
with the nodes standing for concepts or events , and the directed, labeled i 
relations that connect the nodes providing the meaning structure. We st. rted 
off with a scheme heavily dependent upon linguistic consideration, especially 
upon Fillmore's (1968. 1969) case grammar, but this dependence has been much 
reduced as we have gone on to deeper, more cpnceptually based representa'tions . 
Most important, we have learned that the network representation should be 
active, with some of the nodes standing for programs that operate upon the 
network itself. Tlio static nature of the network owes much to the in,' 
sp. ration and insights given to us from our study of Fillmore (1968, 1969) 
>Hul QuilHan (1968, 1969). plus discussions with Kintsch (1972). The need 
t<' consider causal relations and to add a deeper conceptual level of know- 
K'dge to the network came primarily from Schank (In press), and the 
importance of dyna.nie representation, with the memory being an active 
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collection of processes rather than a simple passive network has been con- 
siderably aided by the works of Reitman (1965) and Winograd (1972). These 
latter two points will be emphasized in the remaining part of this paper. 
Collins and Quillian (1972) have discussed a number of the points made in ' 
this paper. 

The Representation of Actions and Concepts 
The representation to be described here is presented in more detail 
and with more justification in the paper by Rume.lhart, Lindsay and Norman 
(1972). Basically, we represent concepts as directed, labeled graph struc- 
tures. A concept is represented by a node in the space: it Jsv defined by 
its relationships to other concepts. Nodes are connected to othW nodes by 
labeled, directed relations. BecaiiSe each relation also has^'^rr inverse , 
the network is bidirectional, although obviously the meaning of a relation 
usually differs from the meaning of its inverse. 

Events are specified in a similar way, except that actions require 
certain arguments. Thus, the node that represents an action may have ob- 
ligatory relations leading from it specifying such things as the agent, 
location, and object of that action. 

Most actions and concepts in the network have a single primary node 
(or type node) that encodes its definition, and numerous secondary nodes 
(or token nodes) that represent specific instances of the primary one. 
Almost all encodings of specific scenes; are done by means of secondary 
nodes . 

Although the structural network is presented here and illustrated 
in the figures as if it were a grapfi, there is a simple formal equivalence 
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between such a graph structure and both list structures and functional nota- 
tipn. All three notations are closely related---networks , lists, and func- 
tions- -and wh\ch is used at any one time becomes a matter of convenience 
and personal preference. 

The basic unit in the memory space is the scenario: an action that 
consists of events, actors, locations, and objects. Later, we will see 
that scenarips also imply causal factors and results. 

Let us illustrate the representation system by analyzing sentences 
2 and 3. ' 



Peter put the package on the table. 
Because it wasi't le\el , it slid off. 



r 



(2) 
(3) 



Figure 3 



Figure 3A shows a possible simple encoding for sentence 2 which includes 
some of the underlying structures of the action. (Notice that the method 
by which the location was caused to change is left unspecified.) Figure 
3B shows a similar encoding for sentence 3. These two figures show how 
the frameworks associated with the verb and concepts must define a more 
complete representation of the events depicted by the sentence. The final 
picture is derived from a consideration of much more information than is 
in the .itwo sentences themselves: 

A. There is no raised edge on the table (else the pack- 
age would not have rolled off)'. 
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PETER 
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■X^PETER > 




<^TABLE 



|PART 
TOP 



PETER PUT THE PACKAGE ON THE TABLE. 



Figure 3A 




PACKAGE 



B: BECAUSE IT WASNT LEVEL, IT SLID OFF. 



f igure 311 
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B. When the package slid off the table, it was left 
unsupported. 

C. All objects heavier than air must be supported or 
else fall. 

D. Therefore, the package fell. 

I;. The usual supporting surface for a t3ble is a floor. 

F. Hence, the package fell to the floor. 

G. When an object falls from a height, it is likely to 
break . 

Expanding the Meaning-structure 

The representation of the scenario shown in Figure 3 is not complete. 
There are two types of expansions that should be performed. First, there 
is expansion to reach the underlying meaning of each to the actions and 
concepts. Second > there is conceptual expansion to consider all the im- 
plications of the scenario. 

Expansion of the individual entries tp get to the underlying meaning 
is necessary not only to enable that meaning to be derived, but also to 
solve the problem of paiaphrase. Consider sentence 2, 

Peter put the package on the table. (2) 
What we mean is that the person we know as Peter caused a particular pack- 
age to bo moved from its former location to some unspecified spot on the 
top surface of a particular table. Moreover, although this need not neces- 
sarily hold, it xs stronj^ly implied that Peter carried the package in his 
hands and then, once the package was on the table, he let go of it. No matter 
what words arc used to describe the action we wish to get the same underlying 
interpretat J on : We must be able to recognize that a sentence like (2) is 



completely equivalent to the dialogue of (j<|) and (13): 

-n^at package on the taLue-.how did it get there? (12) 
It w.-is Peter, he di d i t , 

r " (13) 
Actually such analysis is not too difficult. Many actions reduce to 
basic concepts. In both (2) aiul (12-13). the important concept is that 
Peter caused the package to change location from Its foxxier to its final 
po..ition. the table top. If we had a basic underlying concept of a change-in- 
location concept-, and .f all actions that reflect changes in location were 
translated into this underlying meaaing,, then we would have the solution to 
several problems, including the one of paraphrase. To be able to do this., 
we must have a lexicon that describe, the method oy which actions are defined 
in terns of more fundamental units.. A possible start towards this has been 
shown in Figure 

Conceptual Representation 

When a movable object is placed on a fixed, tilted surf.ace, the object 
is likely to slide along the surface. When an object starts to move it con- 
tinues to do so. either as long as the causal factor of the movement is op- 
erating, or until It reaches some b.iirrier to its movement, In this case, 
th.. causal factor is thav of gravity acting upon a movable object on a tilt- . 
ed surface. When th. surface tex..inate:; , then, if there is no barrier (an 
edge on the table), the ,bjecx must slide off the surface. But an object 
that 15 nut upon a .surface will fall -ontil it reaches one: all heavier- thaii- 
Hir objects mu5,. b. support..!, 11,. table m.;s. also be supported, usually 
by a large surface called the fjocr. Thus, the package will fall from the 
table top to the floor. 
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All of this must be represented: the major question is how. This is 
not the place to attempt more formal analyses for these items, except to 
say that the change in location of the package is the easiest concept of 
the entire scenario: all the complications reside in the explication of 
the movement. Moreover, we have barely begun: each action in the method 
part of the scenario can be expanded. Is there any end? 

The one major conceptual difficulty here is that the complexity of 
the analysis is in conflict with our impressions of how we ourselves under 
stand action sequences. Suppose I had actually watched Peter move the 
package, what would my memory representation be? Intuitively, my picture 
is something like that of Figure 4: a cognitive knowledge of the fact that 
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a transition in the package location has taken place, but with the method 
of the movement filled by something like a sensory image of the acts.'' If 
this is so, then actions should probably not be defined in terms of more 
elementary actions indefinitely, but rather as programs or plans for per. 
forming or thinking about events. 

The Representation of Memories as Plans 
The difficulty with the static, formal network representation of 
memor>- just described is that it is too abstract: there is no contact with 
physical reality. With the humim cognitive system, all input and output 
M . .rmation comes through the sensory ,uiJ motor systems. Thus, our image 
of a concept such as a table or of an action such as to walk is probably 



not *pccified in terms of more and)iiore detailed refinements on the semantic, 
level, hut rather as a sensorimotor image of our experiences. We could 
think of walk as a fonn of motion m which the actor and object are the 
same and in which the method is by mrans of a certain set of motions made 
by the feet of the actor. We could think of st rol 1 , saunter , and a mb le 
as more specific types of walking. But these definitions seem unwieldy: 
we know what these types of walkni}^ are through our sensorimotor routines 
for performing them. 

One wav of cutting the tangled definitional web is to determine the 
place for sensorimotor images. Fortunately, one method is readily available: 
it has already been partially illustrated in l-igure 4. We let the primitive 
definition of actions be the sensorimotor instructions for performing those 
actions, Tliis by itself is not enough. If the representation of a sentence 
such as 

Move the object to the table. (14 
involves the sensorimotor commands for m.ovement , then thinking of the sequence 
also is likely to lead to the movement, lliis is not what we want. We need 
several different ways of using the same sensorimotor representation. We 
should be able to do at least three different things with a given sensori- 
motor p Ian : 

A. Tlie sensorimotor system can be examined, as data. 

B, The sensorimotor system tan be activated, causing 
t he act i (^n . 

('. 'Pie sensorimotor system can be simulated, causing an 
internal representat kmi of thp act ion sequence. 
To illustrate the properties i-f such a representation, consider what 
l[ie structure of a program might l^Mik like. Consider some information stored 



in memory that can also be us./d as instructions to act upon the memory it- 
self. Suppose you are asked to state what is in cotmon between two con- 
cepts, say dogs and cat:;- -how would you do it? Presumably, one does this 
by «oin« to the representation for the two concepts and comparing the rela- 
tion concept pairs that each arc aasocihted with: rhe pairs that are the 
same for both are the thi.igs m onOToa, Che others can be ignored. This 
description of how one mipnc go about comparing two concepts is an exaji5)le 
of using the sen.^ori:i»otor representation as data (an example of A, above). 
Actually performing the compaiison between the concepts would be an exaa- 
ple of activating the representation (an example of use B, above). 

A formal description of the operation for finding the factors coMon 
between two nodes called A and B and putting them on a new node called 
incommon might read like this: 

Define the following as an opeiatoi: coiwnon factors b'tween 

A and B with results ut incommon. 
Paragraph 1. 

Connect incomjnon to the token of commonfactors with 
re'uUt . 

P'iraj^raph i. 

Find a new node- relat ion-pair associated with A. 
If the pair doesn't exist, then stop. 
If that relation coruK'cts B to tliat node, then con- 
nect inconimof: to [he nofle with ^:hat relation. 

Hii;; ;.;»-t ut i n n;,. ? i is o ,,)■( :rMii v'.ai. r'^adily translates into 
^•Mic r,. the rMrni.it fui r-r..,r,-;-nc in,.; ^vcnt:, in rhe Jata base.^ It can be 



used in exactly tho three ways we need, hirst we can examine it as some- 
thing that has been leanied and stored in memor>'. Thus we can answer ques- 

f'igure 5 



tions about how the program works. Second, we can actu:»lly initiate the 
program. Thus, if we were asked what wos in common between dogs and cats, 
presumably we would do so by doing something analogous to the program for 
common factors , using dog and cat as input nodes (in place of A and B) . 
Third, we could simulate the routine by examining each statement in turn 
and seeing what it accomplished. (This v.ould be more appropriate to phys- 
ical actions such as typing a paper than to routines that are performed 
internally, such as comparing two concepts.) 

Note that the routines are defined in terms of primitive actions-- 
the sensorimotor instructions. In the computer realization of this idea 
(which is now in operation), the primitives are machine instructions cap- 
able of being executed. If the instructions refer to intental operations 
(such as to modify the node stiTicturc for a concept), then th*^ primitives 
are defined as operations on the network itself in the internal programming 
language used by the computer, If the instructions refer to external op- 
erations, the ^^sensorimotor" system of the computer, then the result is to 
control the external devices of the computer to type messages or read cards 
or tapo'A . These primitives could just as 'S'isily move an arm or receive 
input from a television "eye/' if our system were implemented on one of those 
half-iiozen machines that have them. 
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This multiple representation has one more virtue. If in the human, the 
end referent of a node is a sensorimotor experience, then we see how someonr 
can : 

A, Learn by doing--trial and eiror construction of a network; 
' by l^i:;^ iri3truct. -uui idiiijj a network that then 
refers to appropriate (and already existing) sensorimotor 
schema! a ; 
C. Kearn by observation. 
Because the program is both executable instructions and data, it can be 
changed or modified in the same way as other information stored in memory 
can be modified. Thus, just as we can learn to modify our knowledge of 
concepts and of events, so too can we learn tc modif)' our actions, 

C aus;; l P a ctors and Memory 

A major feature of the way that a person views the events of the world 
is in tenns of their causal factors. That is, we tend to disbelieve that aii 
event could simply happen by itself; rather we tend to believe that an event 
must have a cause. The tendency to v:ive causal reasons for events probably 
is )eneficial ii; the long run, but such a tendency also gives rise to many 
discrepant, superstitious beliefs. 

We find evidence for the distortions introduced by the apparent neces- 
sity to find causal factois of events in much anthropological and sociology 
ic'il literature (sec l^' Andradt.- , Quinn , Nerlove and Romney, 1972) and even 
in the distortions of stones reportt^d by Bartlett ( 1932). This tendency is 
especially marked in the reproductions of Bartlett ^s story, "The Son Who Tried 
to Outwit fU.s Father" (pp, 1 29- 146). Here we find persistent attempts to add 
reasons for the peculiar acts depicted in the story. Rartlett calls this pheno 
fjnoD "rationalisation." According; to Bartlett, "They were all introduced 
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unwittingly, although in one or two cases a subject said, after giving her 
version, 'I like to have reasons for things, and there aren^t iiany hcre^" 
(p. 136). 

Now, what does all this mean for the structure of menory? A new exam- 
ple illustrates what has to be done. 
The Tliree Drugstores Problem 

The b^sic problem before us was elequently posed by Abelson and Reich 
(1969). I paraphrase their version of the problem in this way: 
Suppose ail individual says a sentence such as, 

"I went to three drugstores.** (j5) 
A response based on syntax only might be, 

**How did you pjo to three drugstores?** (16) 
A response based on some semantics night be, 

'Vhat useful things did you buy in three drugstores?** (17) 
But the most natural response ought to be, 

*Ticw come the first two drugstores didn't have what you wanted?'* (18) 
Let us look at the specific knowledge that must exist in order to provide 
eachi of these possible answers. First, however, there is even one level of 
behavior below the one described by Abelson and Reich. Most ne»ory systems 
that have been formulated today would respond, 

'*Thank you. I have now stored that information." 
This is the level of response implied by most current theories of hin^an mem- 
ory. But we expect humans to respond with something like sentence 18, not 
that of 19, so let us work our way up m complexity, and see what extra in- 
formation or knowledge is requested to respond with the increasing levels 
of sophistication shown by the sequence of (19), (16). (17), and finally, 
the most reasonable one (18). 

To respond as in sentence 19 requires an efficient storage system as well as 
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a good understanding of English. These are not easy tasks to master, but 
they are only the first steps. If we simply stored sentence IS, then in 
terms of our network representation, the input sentence would be represent- 
ed somewhat in the format of Figure 6. 



Figure 6 



Now, consider what knowledge is required to respond as in (16). Here, 
we must realize that £o is a specialized form of motion (location change), 
with a structural fran»ework that has slots for a prior location, a final 
location, and a means of travel. Thus, to say, "I am going to the drug- 
store" implies that I will travel by some unspecified means from my pres- 
ent location (which is not that of the drugstore) to the location of the 
drugstore. With this sentence, several pieces of information that go with 
the verb framework are unspecified-- locations , instruments, times, etc. 
(see Figure 7) . 



Figure 7 



If we know this much, then to attempt to fill in these missing slots 
is only natural: it represents an obv.^ous strategy to complete the structu 
by asking; 
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"How did yoii to triree dni>;s torob ?" 

"From where did you start'?" 

"Wliere did you jjo after the last drugscore?'* 
A Semantical i y -based System . 

What useful things did you buy in three drugstores ? (20) 
Here, motives and purj^oses must get added to the system. To do this is to 
add more than semanti cs - - some understanding of human behavior is also add- 
ed. In specific, it requires the knowledge that most actions are actually 
part of a deeper schemata, that hujnan behavior is goal-oriented. 

We need a further scenario, one that states that people go to drug- 
stores in order to purchase one or more of that special class of things 
sold in drvigstores. Thus, the structural framework must now be expanded 
considerably to include purposes, as well as reasonably complete descrip- 
tions of the concepts and actions that are involved. The general struc- 
tural representation for going to a drugstore starts to look something 
like that of Figure 8. 

- \ - 

I'igure 8 



ilere we have shown the encoding for the types of items contained within 
(American) drugstores arid th*.' pui^»ose of g^ing lo drugstores. This scenario 
points out the need to }'^t eve/i mure i nfon*':! cion about the drugstore trip: 
hence, two new possible questions ai'e 

"Wliat useful things dul .^mi buy in three drugstores?" 
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or even, ^^Where did you get the money?'* 

A Conceptually-based System . 

How coroe the first two drugs tores d idn't have what you wanted? (21) 
For a system to generate this response, the underlying structural framework 
for an action must be further modified. The structure must take on the 
general characteristics of a rule. T)\c basic conceptual structure might 
look something like that of Figure 9. It contains: 



Figure 9 



A. A conditional statement. 

B. An action to be performed if the conditional is true. 

C. A result of that action. 

Nov/ we can expand the picture given to us earlier. We go to a drug- 
store to purchase something. If we then go to a second drugstore, clearly 
the first trip must have failed in its purpose. Similarly, we need to 
visit a third store only if the trip to the second store was unsuccessful. 
Hence, the question we ask in response to the presentation of the orig- 
inal statement 

Movi come the first two stores didn^t have what you wanted?'^ 

F i nd i ng the Suitable Ans w^ rs to Questions 
(^e last stagt* remains in our study of how questions get answered, 
.lust as the acquisition and the search through the knowledge contained in 
memory is a more com})lex task rhan originally thougl>t, so too is the way 
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thai knowledfje gets used when it is finally found more complex than is im- 
mediately obvious. The constniction of a proper answer to a question is 
not performed simply by describing the relevant information that has been 
found. A number of different issues arise in the development of a suit-- 
able answer to a question: let rae examine only one of these issues here. 
The Empi -e State Building Problem 

The most straightforward situation occurs when the question is found 
to have an answer. Except in the most simple psychological expe^fllfcents on 
memory, however, we would not expect that the answer be describable by a 
single word or phrase. Usually we can expect that a large body of informa- 
tion is found relevant to the question, perhaps with several different pos- 
sible interpretations. What then should the respondent do? 

Suppose we consider a question with a reasonably unambiguous answer: 

Where is the Empire State Building? (22) 
But look, a part of my knowledge of the Empire State Building is shown in 
Figure 10. With which part should I respond? To answer this question proper- 
ly requires that the respondent understand the requirements of the person 
who asked the question. If I were asked this quest ion in Russia, I might 
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well respond "In the United States." If I were asked by an adult in Europe, 
I would probal:)ly respond "In New York City." In the United States--espec- 
ially In New York City, I would respond "On 34th Street." Finally, if 
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asked in the New York subway system I would not answer with a location, 
but rather with instructions on how to get there. 

In order to answer a question appropriately, it is necessary to have 
a model of the knowledge of the listener, including knowledge of why the 
question was asked. Full exploration of this issue leads to the development 
of a major set of experimental and theoretical issues, so I will only touch 
on a few now. Basically, a person who is giving a serious answer to a 
question must consider the developing network of information owned by his 
li<;tener and attempt to fill the gaps. To do this well requires reasonable 
depth of knowledge about the listener, or perhaps a sophisticated under- 
standing of the reason that certain questions get asked. ' A humorous, yet 
insightful demonstration of the difficulties involved in answering ques- 
tions without any appreciation for the knowledge base of the listener occurs 
at aiiy cocktail party where strangers from a wide variety of occupations 
meet and ask **What do you do?" If the question is taken seriously, then 
it may require a good deal of conversation to establish sufficient common 
ground that it can be answered at an appropriate level. 

Piaget has studied a highly related problem in the egocentric behavior 
of a young child. As is easily imagined, learning to consider another per- 
son's knowledge in answering a question is not a simple task. Piaget sug- 
gests that the child of seven years or less is unable to do this. The young 
child is egocentric in his behavior, describing everything from his own 
point of view. Thus, he frequently uses pronouns in, his speech without any 
understanding that the referent may not be intelligible to the bewilde?red 
adult to whom h(^ is speaking. 



As far as I can determine, all of the exist inj^ computer-based informa- 
linn retrieval systems are egocentric; their designers are usually so pl»\is-- 
ed that they can sometimes find the information reciuested of them that they 
delnj.ie the inquirer with more information than he can use, as well as in- 
formation that he may already know. Accordinjj to my interjiretat i on of Placet's 

stapes of intellectual development, we would have to say thaU these svstems 

\ 
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had just barely started the acquisition of intelligent behavior. 

To answer a question, intelligently requires a large body of specific 
knowledge about the area being questioned, including general knowledge about 
the w(j)rld and its causal and physical laws, and also an understanding of the 
knowledge and behavior of other people. Those of us trying to model the human 
use of niernor)' have just barely gotten used to the fact that we must add know- 
ledge of the world to the model, so it comes as a surprising and new challc^nge 
that we must also incorporate a person's underst^inding of other people into 
the model. A number of interesting philosophical issues are encountered in 
this new problem: I refer the. reader to the insightful treatment of some of 
these issues in Minsky's chapter, "Matter, Mind, and Models "(1968J. 

The Acquisition of Know ledge 
We have now examined a number of different features about the representa- 
tion of information in memory. We have seen how an active representation 
based on a sensorimotor process seems to be necessary, with the previously 
acquired knowledge about the world providing a structural framework upon which 
to construct new knowledge. nic [>rr -e x i s t i ng structure not only defines the 
way that new information will be represented, but it helps :in organizing the 
information that is not yet known. I bus , the structure can maintain oj>en 



positions within its framework for the necessary causes and results, objects 
and actors, and even methods and actions that still remain unspecified. In 
this way, a person acquiring knowledge can be led to seek more information 
to fill the missing nodes in his developing memory representation. ' 
Learning 

Teaching and learning are the names we give to the activities of pre- 
senting and acquiring new ini 'nnation . There is no adequate theory of in- 
struction to guide us in these activities: perhaps an examijiation of the ^ 
structure of memory from the viewpoint represented by this paper might pro- 
vide aseful guidelines for the development of such a theory. Indeed, 
Macdonald-Ross (1972) ^has studied network relationships with just this goal 
in mind: to determine how to design an educational system for the Open Univer- 
sity in England. Macdonald-Ross argues that structures of this nature do 
glide both students and faculty into an understanding of their subject matter, 

r 

Examine the structure of memory. It is ah interconnected network, with 
new facts supported within the skeletal structure provided by the old. To 
acquire new information means to construct new nodes and the relations between 
them. Consider how that might get done. First, let Figure llA represent a 
segment of knowledge in the memory. If we acquire two new concepts (CI, C2) 



Figure II 



and ?L relation between them (R) as shown in Figure IIB, there are no connec- 
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tions to the old network. Retrieval should be difficult, and perhaps even 
the acquisition is difficult. This is poorly \eamed infomation. 

Now consider Figure lic. Here, the two newly acquired nodes are well 
integrated. To use an obvious analogy drawn from the structure itself, we 
would say that the newly learned components of IIC are well supported; those 
^of llB lack support. Notice, too. that IIC is better integrated within the 
network, in part because it contains more information. If this view of things 
is correct, it explains why mnemonic techniques are so useful in causing ar- 
bitrary stringr. of items to be learned even though they add to the total 
amount of material that is to be acquired. They provide a fi™. well in- 
tegrated structural framework. 
Teaching 

Suppose we have a large body of knowledge to teach-what is the best 
way of doing it? Presumably, we n--^ to interconnect the new infonnation 
with the existing structure. One way to do this is to construct a support- 
ing web structure first, and then fill in the details. To do the details 
first would not work, for without a supporting structure, the new material 
simply could not become integrated. In teaching, this means that an outline 
of the material to be learned should be acquired first, then a more detailed 
overview, and then progressively more and more detailed structures. 

•nie network representation of knowledge can guide the process of instruc- 
tion in two different ways. First, if we have a good representation of the 
knowledge we wish to teach, then we can organize it properly for efficient 
learning. Second, if we try to discover the network representation of the 
^udent. we can use this t( ^uide our teaching. Knowing the knowledge struc- 
ture of the student helps in devising the original level of organization of 




thu material. In addition, as the lessons progress, we can use our under- 
standing of the development of the student's structures to guide us in teach- 
ing, ^'telling us what old material has not been acquired and what new material 
mi^ght perhaps already be known. Thus, in theor>' it should be possible to ^ 
tailor instijuction to the knowledge base and competence of the student. 

Whether the network representation makes the goal easier to attain re- 
mains to be seen. The major drawbacks have seemed to result f^om the tyranny 
of numbers: tutorial methods are too expensive to use in mass education, 
lectures, texts, and even are not flexible enough. Most teaching machine 
programs and computer-assisted instructional systepis simply are not yet sophis- 
ticated enough in their implementation to attempt these goals (with the excep- 
tion of the demonstration systems of Brown, Burton and Zdybel, 1972, and Carbonell, 
1970). Nonetheless, tho analysis is instructive even if the implementation 
remains in the future. 

We can characterize two different strategies of presenting material: 
two different strategies of teaching. One is to present a cohesive organized 
structure to the student, carefully adding one new piece of information after 
another to the developing structure. This might be called linear teaching . 
It .is the system that characterizes lectures, textbooks, and even the struc- 
ture of this paper. The other method is to present a coarse web of informa- 
tion, outlining the topics to be discussed, then giving a general overview, 
more detailed ovei^iews, and finally the detailed substxoicture . TTiis proce- 
dure might be called web teaching . Web teaching is often prescribed, seldom 
done. It is difficult to perform well. But I wish to suggest that for the 
learning; of complex topic matters, web teaching may at times be mr^re efficient. 



The distinction here between web and linear strategies are closely 
related to, yet different from, the distinction between holistic and serial- 
istic strategies of learning (Pask, 1971; Pask and Scott, 1972). Pask and 
Scott gave students freedom to explore a network of knowledge about prob- 
nbility theory. Some students, the serialists, preferred to work on one 
node at a time, always completing that node before going on. Others, the 
holists, worked on many nodes at a time. These are interesting results that, 
hopefully, can be used to characterize styles of learning. 

Linear Teaching. Linear teaching (and its complement, linear learning) 
might be characterized by the sequence shown in Figure 12. At first, there 
is a well developed structure of knowledge (Figure 12A) . Then, we add a 
new set of nodes, say the linear string CI, C2, and C3, and their subnodes. 



Figure 12 



as shown in Figure 12B. Finally, a longer linear string is acquired, nodes 
CI through C5 in Figure 12C. Presumably, as learning increases, the older 
material becomes more thoroughly embedded into the knowledge structure, but 
the overall picture is still one of a systematic linear increase in the know- 
ledge base. But this new knowledge is weakly supported. If one link in the 
chain is lost, either because it was poorly acquired or because the learner 
might have missed that part of the material, then the rest of the structure 
is weakened imd. conceivably, may fail. This is a .familiar experience to 
mosi instructors: a student who fails to learn the point made earlv in the 
course may thereafter be in dif>i^lty. failing to understand all that has 
followed. ^' 
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Web Teachi ng. Web teaching (and web learning) might be characterized 
by the sequence shown in Figure 13. Here, we use the first few nodes acquir- 
ed (Figure 13B) to establish a coarse web. but one that is well integrated 



Figure 13 

with the previous Knowledge structure. Then we insert refinements, within 
the structure created by the original web framework, as shown in Figure i3C. 
Finally, we can fill in the details, as shown in Figure 13D. In web leam- 
inR. no single node is critical to the whole, so that poor acquisition or 
even the absence of a single set of concepts does not destroy the validity 
of the structure. 

The structures described in these two diagrams (Figures 12 and 13) are 
at best weak analogies to the process of learning and teaching. As yet, they 
are far from being a foimal. testable theory. But I find the analogies in- 
sightful ones, useful even at this early stage of development in the planning 
of course materials. Whether there is any more to the distinctions between 
web and linear teaching than simple analogies remains to be investigated. 
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Sununary 

When we examine in detail the nature of memory we find that we cannot 
separate the representation of knowledge from the uses to which we put that 
knowledge. It is possible to devise formal representation of knowledge 
within human memory. To do so requires some type of network, with distinc- 
tive means of representing concepts and actions. But even with such a 
representation, we find that there is much more to the process of memory 
than simply storing the information away. 

When peoplfe are asked questions, they do not simply go into their 
memory and respond with the appropriate infoiroation. Rather, they first 
investigate the question itself, determining whether it be sensible 
or not, or what its exact referents are. Even when some information is 
retrieved, it is likely to be deeply imbedded within a general structural 
framework determined by knowledge of the world itself, and this' extra 
information can bias the type of memory responses that ai;e given. Thus, 
it is possible to show how people mig^t make errors in information that 
presumably they have learned very we/l, for example, even in recalling 
the f loorplan of the apartment in which they are then living. 

It is neither possible nor desirable to separate memory for action 
from the plans necessary to execute those actions. Thus, it should be 
possible to store within memory a sequence of instructions that can be 
u-sod in different ways: 
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1. We can examine the instruction as something that has been learned, 
as data within the memory structure. 

2. We can activate the instruction, causing the action thereby des- 
cribed to be performed. 

That information stored in memory can be used in these two different ways 
is an important concept, for now we can see how learning can cone about by 
actual performance, by instruction, by thought, or by observation. 

When we teach someone else knowledge, we are trying to build within 
that person a data base comparable to that of our own for the particular 
subject matter of interest. But in order to do this we must know what the 
other person knows and what he lacks. What is needed is sone sort of in- 
teractive process, in which we first question the other person to find out 
what is lacking, then teach, and then question again to find out how success- 
ful we have been. 

In answering a question, it is important to be able to do nore than 
simply combine infoimation about the world with information that has been 
learned about the question. In order to derive the proper answer we must 
determine exactly why the question was asked, else we are likely to answer 
at the wrong level. This means that in addition to the knowledge of the 
subject being asked about, we must also have knowledge of the person who. 
has asked the question. Consideration of these topics leads to a theory 
of instruction, a theory which states the importance of properly connecting 
new material into the framework provided by the old. 

In this paper, a general fonnal structure for representing semantic 
information is proposed. Examples are given of network structures for encod- 
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ing both general knowledge about the world and also specific inforrtiaticn 
learned about a particular concept or event. The structure is now being 
tested by simulating it on a large digital computer. The result of these 
investigations is the realization that there is much more to the memory process 
than has heretofore been described in our theories. 
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This research is supported by research grartt GB 32235X from the National Science 
Foundation. Many of the concepts discussed in this paper have come from the ac- 
tivities of the "LNR Research Group," most especially the insights of David Ru- 
melhart and Adele Abrahamson, Marc Eisenstadt, Dedre Centner, Yaakov Kovarsky, 
Jim Levin, and Steve Palmer. 

George Mandler is responsible for first demonstrating to me th^ importance of pre- 
processing by devising the question, "What is Professor Luria's telephone number?" 
The answer, "Why on earth would I know his phone number?" proved to be a, central 
influence in developing, the sets of queries and analyses presented in this paper. 
In a network representation of memory, everything is eventually connected to every- 
thing else, so that if twp items exist somewhe-« in memory ,^here wust be some path 
connecting them, although that path may be non-meaningful. 

The search probably takes place by some variation of a depth- first search, starting 
at all the 'nodes corresponding to the concepts of the input query. The intersec- 
tions which result when the searches which start at different nodes overlap one 
£.jiother det,ermine the. paths to be examined. Many possible variations exist on this 
simple strategy for rapid, initial search, but the basic idea is to do an initial 
rapid preprocessing of the question .n order to e ,tablish some relationship among 
the items as quickly ?s possible. Whether the search process is sequential or 
parallel, active or passive, is not known. / 

1 thank Marc Eisenstadt and Yaakov Kovarsky for collecting some of the floorplans. 
This type of expansion of a given lexical item into more primitive definitions 
has been taken from the work of the generative semanticists . I have been most in- 
fluenced by Miller's analysis of verbs of motion (Miller, 1971) and Schank's (In 
press) structural analyses. The points that causality is an essential part of the 
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analysis of an action sequence, that the instrument of an action is. in fact, 
an entire action sequence, another event rather than simply a single concept, 
comes from Schank. (Schank calls his bas.c verb of change-of-location trans., 
The particular expansion, of F.g. e 3 are modifications of the analyses per- 
formed by the "Verb Croup" subsection of ,nr research group who actually do a 
more thorough analys.s. breaking down a verb like gut into the sequence of ac- 
tions do, cause , location-chan |^e . 
7. What 1 have in mind here is the fact that formal network or logic representa- 
tions of events are unwieldy, perhaps fundamental 1, so. Analogical representa- 
tion, however, is much richer in scope, for a single simple analog of a situa- 
tion can be equivalent to a large complex of logical statements ab^ut the sM,e 
Situation, as well as containing information not easily (or even not possibly) 
represented in formal language systems. An analogical representation need not 
be the same as a picture in the head, for the representation could be much more 
^.bstract and stored in any one of numerous formats, including digitally. M::.h 
of my reasoning is captured by the recent discussion on analogical represents- 
tion by Sloman (1971). 

. The program is written in the format of SOL II. . language developed and im- 
plemented by David Run,ei:>art. The parser that ho has implemented along the 
lines of the recursive, augmented transition network parser of Woods (1970) 
transforms statements in SOL II into the data base format, as in Figure 5. 
Pronouns and anaphoric references across sentence boundaries are permitted, as 
the example. 

Most people on hearing this ana.ysis object that it is too specific: there are 
^ots of reasons for visiting several drugstores -casing them for a robbery, price 
shopping, selling newspaper advertisements. The objections simply serve to 
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Strengthen the point, however, for they all assume a purpose and result for 
each visit . The point of the analysis is that people infer motives and 
causal factors, and that the structural framework for representing conceptual 
information must include causes and results. 

The subtelties involved in answering questions of this sort and the Empire 
State ouilding example were pointed out to me by Marc Eisenstadt and Yaakov 

Kareev. 
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